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Summary 

An  adaptive  transform  coding  algorithm  based  on 
a  recursive  procedure  in  the  transform  domain  has 
been  developed.  Both  the  quantization  parameters  and 
bit  assignment  are  dynamically  determined  and  thus 
are  closely  matched  to  the  actual  image  structure. 
Overhead  requirements  are  minimal. 

Introduction 

Transform  coding  techniques  for  data  compression 
have  been  considered  in  numerous  current  studies.  In 
particular,  the  recently  published  proceedings  of  a 
specialized  conference  on  image  coding  included  a  sig¬ 
nificant  number  of  papers  on  image  transform  coding.  * 

Transform  techniques  have  been  demonstrated  to 
be  effective  although  significantly  more  demanding  in 
terms  of  potential  hardware  implementation  than  sim¬ 
pler  procedures  operating  in  the  spatial  domain.  Con¬ 
sequently,  most  studies  concentrated  primarily  on 
procedures  that  would  result  in  simplified  implementa¬ 
tion  even  at  the  expense  of  performance. 

In  contrast,  the  procedure  discussed  in  this  paper 
places  performance  as  its  primary  objective.  Although 
algorithm  complexity  is  not  ignored,  it  is  only  of  sec¬ 
ondary  consideration. 

Reasons  for  Adaptivity 

Implicit  in  all  efficient  data  compression  proce¬ 
dures  is  the  fact  that  only  '  new  "  information  is  trans¬ 
mitted  to  the  receiver  via  the  communication  channel. 
Equivalently,  information  that  is  known  to  the  receiver 
should  not  be  trai.smitted.  Generally,  the  latter  type 
of  information  represents  some  type  of  statistical 
characterization  of  the  source  (that  is,  the  image). 

In  the  following  discussion,  we  will  consider  sta¬ 
tistical  characterization  of  the  transform  domain.  A 
transform  coding  system  may  be  represented  by  the 
schematic  diagram  shown  in  Figure  1.  Here,  the 


modeling  concept  refers  to  information  known  to  both 
the  transmitter  and  the  receiver.  Most  transform 
coding  algorithms  assume  the  separable  correlation 
function  associated  with  the  Markov  model  that  also 
presupposes  image  stationarity.  This  model  repre¬ 
sents  a  nonadaptive-type  coding  approach  where  image 
subsections  are  allocated  a  fraction  of  the  available 
bandwidth  in  linear  proportion  to  the  subimage  size. 

Even  casual  observation  of  various  images  sug¬ 
gests  that  techniques  that  permit  a  more  flexible  (non¬ 
stationary)  model  are  likely  to  result  in  superior  per¬ 
formance.  Although  this  philosophy  is  not  new, 
solutions  to  this  modeling  approach  have  been  few  and 
were  restricted  to  the  case  where  the  image  was  par¬ 
titioned  into  a  few  classes  to  be  separately  encoded.  ^ 

An  Improved  Model 

Implicit  in  rll  transform  coding  procedures  is  the 
primary  transform  property  that  produces  approxi¬ 
mately  uncorrelated  coefficients.  Assumption  of  an 
uncorrelated  transform  domain  and  the  Markov  model 
determines  the  optimum  coding  procedure.  Although 
we  aleo  utilize  the  useful  property  of  transformation  to 
produce  (almost)  uncorrelated  coefficients,  we  further 
make  the  obs.ervation  that  the  standard  deviations  of 
adjacent  coefficients  are  approximately  the  same.  A 
more  formal  statement  for  this  case  is:  Although  the 
coefficients  are  uncorrelated,  if  we  also  treat  the 
coefficient  variances  as  random  variables,  this  second 
set  of  random  variables  is  highly  correlated.  This 
transform  domain  property  is  significant  since  it  per¬ 
mits  additional  performance  gains  over  the  simpler 
Markov  model  discussed  above. 

Recursive  Coding 

The  assumption  of  a  strong  correlation  of  trans¬ 
form  coefficient  variances  permits  implementation  of 
dynamically  determined  quantization  models.  A  recur¬ 
sive  procedure  requires  a  one-dimensional  ordering  of 


Figure  1.  Schematics  of  Transform 
Coding 
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the  two-dimensional  transform  domain.  This  ordering 
can  be  performed  several  different  ways.  We  chose 
tjfct'  •n**'catert  2  tt'» 

lattice  represents  a  "conventional"  two-dimensional 
transform  of  an  image  sub-block  (we  used  the  two- 
dimensionai  cosine  transform  over  16  X  16  and  32  x  32 
sub-blocks).  The  continuous  "zig-zag"  pattern  scans 
the  transform  domain  from  the  large  through  the  small 
variance  values.  A  typical  example  of  this  procedure 
demonstrates  the  validity  of  the  technique  (Figure  3[a] ). 
This  illustration  indicates  that  the  particular  scanning 
approach  is  reasonable  and  that  strong  correlation 
exists  among  adjacent  coefficient  variances.  The  lat¬ 
ter  observation  becomes  even  more  evident  when  many 
sub-blocks  are  averaged  together  (Figure  3[b]). 
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For  the  one-dimensional  ordering  of  the  transform 
domain,  the  schematic  of  the  coding  is  shown  in  Fig¬ 
ure  4.  This  dis^rarr*  re^ift  snail  s  th*  elepa- 


Figure  2.  Ordering 
of  the  Frequency 
Domain 
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The  dc  term  Is  and  it  is  coded  separately.  The 
"initial  value"  must  be  transmitted  e  ver  the  com¬ 
munication  channel.  Thus,  it  represents  overhead. 
However,  it  is  the  only  one  for  the  coding  procedure 
under  discussion.  Equation  (1)  represents  the  quantiz¬ 
ing  as  well  as  the  reconstruction  steps.  The  bit  as¬ 
signment  procedure  is  also  implicit  in  this  equation  via 

tin.  uiiv  ^itloiitil  ' fcTjio., 


where 

n.  =  the  integer  value  of  Z.,  for  2.  >  0 
1  ®  11 

n.  =  0  .  for  Z.  <  0 

1  I 

The  actual  value  of  D  determines  the  bit  rate. 
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Previously  discussed  generalized  phase  concepts^ 
are  also  applicable  and  were  utilized,  instead  of  the 
direct  coding  of  the  cosine  coefficients,  pairs  of  coef¬ 
ficients  were  mapped  into  amplitude  and  phase  terms 
that  were  then  encoded. 

Let  x^.  and  5^21  +  1  ^appropriate  coefficients. 

Then  the  mappiniu  into  amolituJe  and  fhase  is  >iiven  by 


Although  this  mapping  is  similar  to  the  method 
associated  with  the  Vourier  transform  the  structural 
properties  associa.ed  with  the  latter  are  neither  appli¬ 
cable  nor  required.  The  advantage  of  the  gen'  ralized 
amplitude  and  phase  decomposition  lies  in  th  fact  that 
th  e  phase  info’mation  dominates  and  the  appropriate 
rptimum  quantizer  is  uniform. 

It  can  he  shown^  that  the  amplitude  can  be  coded 
ftppiuXi.i..’.t._ly  by  1  Idt  I'Lsd  tl,cin  die  ptiasc  when  the 
mean-square  error  is  the  image  quality  measure.  The 
recursive  coding  technique,  described  by  Eqs.  (1) 
through  (4),  is  directly  applicable  to  the  amplitude 
terns  and  was  utilized  for  the  actual  experiments. 
Dvnamically  determined  amplitude  bit  assignment 
values  for  oeveral  typical  16  x  16  sub-blocks  are 
shown  in  f'igure  5.  Two  significant  observations  can 
be  made  from  the  various  curves.  The  first  is  that  the 
actual  image  nonstationarity  can  result  in  sign,  hcantly 
different  bit  assignment  for  different  image  sub-blocks. 
The  second  observation  is  that  the  recursive  coding  is 
"self-terminating."  The  latter  expression  refers  to 
the  fact  that,  whenever  the  predicted  code  word  is  less 
than  1  (see  Eq.  [4]),  the  coding  procedure  is  termi¬ 
nated  for  that  sub-block. 

Results 

We  have  successfully  experimented  with  various 
types  of  imagery.  It  was  found  that  the  assumption  of 
image  nonstationarity  is  necessary  for  efficient  encod¬ 
ing  at  low  rates.  Using  the  recursive  technique  over 
the  16  X  16  and  32  x  32  sub-blocks,  the  algorithm  can 
operate  ?t  0.  25  bit/pixel  with  little  visual  degradation. 
In  apfccial  i.aoes  it  call  Ope.aie  as  low  0,  1  Uli/plxel. 
The  appropriate  performance  values  are  shown  in 
Figure  6,  and  pictorial  demonstrations  are  shown  in 
Figures  7  and  8.  In  all  cases,  the  cosine  transformation 
was  utilized.  The  companding  quantizer  was  imple¬ 
mented  for  the  aunp’itude,  and  the  appropriate  proba¬ 
bility  density  function  was  assumed  to  be  Rayleigh. 
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Figure  5.  Adaptive  Bit  Assignment  Examples 
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Figure  6.  Performance  Values  Associated  with  Coding  Examples 
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Figure  7.  Adaptive  Coding  of  Girl 
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Figure  8.  Adaptive  Coding  of  Couple 


6 


